Proof and Implementation of Algorithmic Realization of Learning Using Privileged Information (LUPI) Paradigm: SVM+
نویسندگان
چکیده
Vapnik et al. recently introduced a new learning paradigm called Learning Using Privileged Information (LUPI). In this paradigm, along with standard training data, the teacher provides the student privileged (additional) information, yet not available at test time. The paradigm is realized by implementation of SVM+ algorithm. In this report, we give the proof of the SVM+ algorithm and show implementation details in MATLAB quadratic programming (quadprog()) function provided by the optimization toolbox. This allows us to obtain a vector ~x that minimizes the quadratic function.
منابع مشابه
Conformal Prediction in Learning Under Privileged Information Paradigm with Applications in Drug Discovery
This paper explores conformal prediction in the learning under privileged information (LUPI) paradigm. We use the SVM+ realization of LUPI in an inductive conformal predictor, and apply it to the MNIST benchmark dataset and three datasets in drug discovery. The results show that using privileged information produces valid models and improves efficiency compared to standard SVM, however the impr...
متن کاملSMO-Style Algorithms for Learning Using Privileged Information
Recently Vapnik et al. [11, 12, 13] introduced a new learning model, called Learning Using Privileged Information (LUPI). In this model, along with standard training data, the teacher supplies the student with additional (privileged) information. In the optimistic case, the LUPI model can improve the bound for the probability of test error from O(1/ √ n) to O(1/n), where n is the number of trai...
متن کاملLearning with Privileged Information for Improved Target Classification
This work considers “Learning Using Privileged Information” (LUPI) paradigm. LUPI improves classification accuracy by incorporating additional information available at training time and not available during testing. In this contribution, the LUPI paradigm is tested on a Wide Area Motion Imagery (WAMI) dataset and on images from the Caltech 101 dataset. In both cases a consistent improvement in ...
متن کاملHuman Activity Recognition Using Robust Adaptive Privileged Probabilistic Learning
In this work, a novel method based on the learning using privileged information (LUPI) paradigm for recognizing complex human activities is proposed that handles missing information during testing. We present a supervised probabilistic approach that integrates LUPI into a hidden conditional random field (HCRF) model. The proposed model is called HCRF+ and may be trained using both maximum likel...
متن کاملOn the Theory of Learning with Privileged Information
In Learning Using Privileged Information (LUPI) paradigm, along with the standard training data in the decision space, a teacher supplies a learner with the privileged information in the correcting space. The goal of the learner is to find a classifier with a low generalization error in the decision space. We consider an empirical risk minimization algorithm, called Privileged ERM, that takes i...
متن کامل